fixed precisionの例文

例文

もっと例文:   1  2

1. The gamma function can be computed to fixed precision for by applying integration by parts to Euler's integral.
2. A formula for fixed precision in serial sampling to test Taylor's law was derived by Green in 1970.
3. FFmpeg has an implementation of an ATRAC3 decoder, which was converted to fixed precision and implemented in the Rockbox series of firmwares for MIPS processors.
4. Quantization can be reduced by using high precision while editing ( notably floating point numbers ), only reducing back to fixed precision at the end.
5. The relative error bound of " every " ( backwards stable ) summation method by a fixed algorithm in fixed precision ( i . e . not those that use arbitrary precision arithmetic, nor algorithms whose memory and time requirements change based on the data ), is proportional to this condition number.